Reduced-Order Modeling of Deep Neural Networks
نویسندگان
چکیده
We introduce a new method for speeding up the inference of deep neural networks. It is somewhat inspired by reduced-order modeling techniques dynamical systems. The cornerstone proposed maximum volume algorithm. demonstrate efficiency on networks pre-trained different datasets. show that in many practical cases it possible to replace convolutional layers with much smaller fully-connected relatively small drop accuracy.
منابع مشابه
Reduced order modeling of ODE-PDE networks
We propose a model order reduction (MOR) approach for networks containing simple and complex components modeled by linear ODE and nonlinear PDE systems respectively. These systems are coupled through the network topology using the Kirchhoff laws. We consider as application MOR for electrical networks, where semiconductors form the complex components. POD combined with discrete empirical interpo...
متن کاملPerformance Modeling of Distributed Deep Neural Networks
During the past decade, machine learning has become extremely popular and can be found in many aspects of our every day life. Nowayadays with explosion of data while rapid growth of computation capacity, Distributed Deep Neural Networks (DDNNs) which can improve their performance linearly with more computation resources, have become hot and trending. However, there has not been an in depth stud...
متن کاملModeling Information Flow Through Deep Neural Networks
This paper proposes a principled information theoretic analysis of classification for deep neural network structures, e.g. convolutional neural networks (CNN). The output of convolutional filters is modeled as a random variable Y conditioned on the object class C and network filter bank F . The conditional entropy (CENT) H(Y |C,F ) is shown in theory and experiments to be a highly compact and c...
متن کاملModeling Interestingness with Deep Neural Networks
This paper presents a deep semantic similarity model (DSSM), a special type of deep neural networks designed for text analysis, for recommending target documents to be of interest to a user based on a source document that she is reading. We observe, identify, and detect naturally occurring signals of interestingness in click transitions on the Web between source and target documents, which we c...
متن کاملCystoscopy Image Classication Using Deep Convolutional Neural Networks
In the past three decades, the use of smart methods in medical diagnostic systems has attractedthe attention of many researchers. However, no smart activity has been provided in the eld ofmedical image processing for diagnosis of bladder cancer through cystoscopy images despite the highprevalence in the world. In this paper, two well-known convolutional neural networks (CNNs) ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computational Mathematics and Mathematical Physics
سال: 2021
ISSN: ['1555-6662', '0965-5425']
DOI: https://doi.org/10.1134/s0965542521050109